Integrated sensor-optical component accessory for image capture device

ABSTRACT

An image capture system includes an image capture device and an integrated sensor-optical component accessory. The integrated sensor-optical component accessory is releasably connectable to the image capture device and includes identification data. A processor in the image capture device configures itself and the image capture device based on the identification data. Image data from the integrated sensor-optical component accessory is processed and image data from the image capture data is either processed or ignored depending on the configuration. In an implementation, attachment information may also be used for configuration. In an implementation, multiple integrated sensor-optical component accessories may be connected to the image capture device. In an implementation, the center axis of the fields of view of the image capture device and the integrated sensor-optical component accessory may be in different directions or the same direction, and the fields of view may be overlapping or non-overlapping.

CROSS REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit of U.S. Provisional Application No.62/829,275, filed on Apr. 4, 2019, the contents of which areincorporated by reference herein in its entirety.

TECHNICAL FIELD

This disclosure relates to image capture devices, in particular,integrated sensor-optical component accessories for image capturedevices.

BACKGROUND

Image capture devices are used in various applications including, forexample, hand-held cameras and video recorders, drones, and vehicles.Image capture devices typically include one or more optical elements,e.g., lenses, as well as one or more image sensors, image signalprocessors, encoders, or combinations thereof to capture and processimage data. More specifically, the optical element(s) capture content byreceiving and focusing light via, and the captured content is convertedto an electronic image signal by the image sensor. The image signalgenerated by the image sensor is then processed by an image signalprocessor to form an image, which may be stored and/or encoded.

Many image capture devices are fixed in terms of functionality. Forexample, each of the fixed optical elements included in an image capturedevice has an associated field-of-view that extends in lateral andlongitudinal directions. There is no mechanism for re-configuring thefunctionality of the original image capture device.

SUMMARY

Disclosed herein are implementations of integrated sensor-opticalcomponent accessories for image capture devices. An image capture systemincludes an image capture device and an integrated sensor-opticalcomponent accessory. The integrated sensor-optical component accessoryis releasably connectable to the image capture device and includesintegrated sensor-optical component accessory identification data. Aprocessor in the image capture device configures itself and the imagecapture device based on the integrated sensor-optical componentaccessory identification data. Image data from the integratedsensor-optical component accessory is processed and image data from theimage capture data is either processed or ignored depending on theconfiguration. In an implementation, attachment information may also beused for configuration. In an implementation, multiple integratedsensor-optical component accessories may be connected to the imagecapture device. In an implementation, the center axis of the fields ofview of the image capture device and the integrated sensor-opticalcomponent accessory may be in different directions or the samedirection, and the fields of view may be overlapping or non-overlapping.

In an implementation, an image capturing system includes an integratedsensor-optical component accessory and an image capturing device. Theintegrated sensor-optical component accessory and an image capturingdevice both capable of capturing image information. The image capturingdevice includes a body, an image sensor internal to the body, an opticalcomponent structured on the body, and a processor configured to processselected image information. The image capturing device and the processorare configurable based on identification data received from theintegrated sensor-optical component accessory when the integratedsensor-optical component accessory is releasably attached to the imagecapturing device. In an implementation, the selected image informationis based on the identification data.

In an implementation, an image capturing apparatus includes an imagecapturing device and an integrated sensor-optical component accessory.The integrated sensor-optical component accessory and an image capturingdevice both capable of capturing image information. The image capturingdevice includes an image sensor, an optical component, a processor forprocessing selectable image information, and a first mounting structure.The integrated sensor-optical component accessory includes an imagesensor, an optical component fixed in relation to the image sensor, anda second mounting structure. The processor is configurable based onidentification data received from the integrated sensor-opticalcomponent accessory and attachment information when the integratedsensor-optical component accessory is releasably attached to the imagecapturing device using at least the first mounting structure and thesecond mounting structure. In an implementation, the selected imageinformation is based on the identification data and the attachment data.

In an implementation, a method of using an image capturing system. Themethod includes releasably attaching an integrated sensor-opticalcomponent accessory to an image capturing device. The image capturedevice receiving integrated sensor-optical component accessory controlinformation from the integrated sensor-optical component accessory. Theintegrated sensor-optical component accessory control information beingdifferent for different integrated sensor-optical component accessories.A processor in the image capture device and the image capture devicebeing configurable based on the integrated sensor-optical componentaccessory control information and processing selected image data basedon the integrated sensor-optical component accessory controlinformation.

BRIEF DESCRIPTION OF THE DRAWINGS

The disclosure is best understood from the following detaileddescription when read in conjunction with the accompanying drawings. Itis emphasized that, according to common practice, the various featuresof the drawings are not to-scale. On the contrary, the dimensions of thevarious features are arbitrarily expanded or reduced for clarity.

FIGS. 1A-D are isometric views of an example of an image capture device.

FIGS. 2A-B are isometric views of another example of an image capturedevice.

FIG. 2C is a cross-sectional view of the image capture device of FIGS.2A-B.

FIGS. 3A-B are block diagrams of examples of image capture systems.

FIGS. 4A-B are a perspective view and a schematic representation of animage capture device.

FIG. 5 is a diagram of an image capture system including an imagecapture device having an attached integrated sensor-optical componentaccessory in accordance with embodiments of this disclosure.

FIG. 6 is a diagram of an image capture system including an imagecapture device with an attached integrated sensor-optical componentaccessory using an interface structure or frame in accordance withembodiments of this disclosure.

FIG. 7 is a diagram of an image capture system including an imagecapture device with an attached integrated sensor-optical componentaccessory using a cable in accordance with embodiments of thisdisclosure.

FIG. 8 is a diagram of an image capture system including an imagecapture device with an attached integrated sensor-optical componentaccessory with multiple sensor-optical components in accordance withembodiments of this disclosure.

FIG. 9 is a diagram of an image capture system including an imagecapture device with multiple attached integrated sensor-opticalcomponent accessories in accordance with embodiments of this disclosure.

FIG. 10 is a side view of a diagram of an image capture system includingan image capture device with an attached integrated sensor-opticalcomponent accessory in accordance with embodiments of this disclosure.

FIG. 11 is a side view of a diagram of an image capture system includingan image capture device with an attached integrated sensor-opticalcomponent accessory in opposing directions in accordance withembodiments of this disclosure.

FIG. 12 is flowchart of an example of a process for attaching anintegrated sensor-optical component accessory to an image capture devicein accordance with embodiments of this disclosure.

DETAILED DESCRIPTION

Disclosed herein are implementations of integrated sensor-opticalcomponent accessories for image capture devices. The integrated imagesensor-optical component accessories include an image sensor and anoptical component that may be coupled to each other in a preciselydetermined spatial or fixed arrangement to optimize the image sensor andoptical component pairing. In an implementation, the optical componentis a lens or multiple lenses. In an implementation, the image sensors inthe image capture modules are maintained inside environmentally proofhousings, such as for example, waterproof housings. The image capturedevice includes an on-board image sensor and optical component forcollectively capturing image information and a processor for processingthe image information. The integrated sensor-optical component accessoryis releasably attachable to the image capture device. The processor maysupport multiple integrated sensor-optical component accessories and maybe configurable based identification provided by the integratedsensor-optical component accessory. The processor may configure itselfand operation or functionality of the image capture device based on theimage sensor, lens, field of view, and other like features orcharacteristics of the integrated sensor-optical component accessory. Inan implementation, the processor may configure itself and operation orfunctionality of the image capture device based on where and how theintegrated sensor-optical component accessory is attached to the imagecapture device.

In an implementation, the image capture device and the integratedsensor-optical component accessory may include mounting structures thatmay provide releasable mechanical coupling and electrical connectivity.In an implementation, the electrical connectivity may be used to providepower and facilitate the transfer of data between the image capturedevice and the integrated sensor-optical component accessory. In animplementation, the data may include image data and identificationinformation from the integrated sensor-optical component accessory. Inan implementation, the data may be transmitted wirelessly between theimage capture module and the integrated sensor-optical componentaccessory.

Each of the integrated sensor-optical component accessories may beconfigured to provide image capture functions differently from eachother, such as by having different resolutions, light sensitivities,frame rates, fields of view, and/or fixed or variable focal lengths. Asa result, the image capture device may, by coupling different ones ofthe integrated sensor-optical component accessories to the image capturedevice, provide different image capture functions. In an implementation,the processor may configure image processing of image information froman attached integrated sensor-optical component accessory instead ofon-board or fixed image sensor and optical component of the imagecapture device. In an implementation, the processor may configure imageprocessing of image information from both an attached integratedsensor-optical component accessory and an on-board or fixed image sensorand optical component of the image capture device. In an implementation,different fields-of-view and perspectives may be configured using bothan attached integrated sensor-optical component accessory and anon-board or fixed image sensor and optical component of the imagecapture device. Advantageously, a user of the image capture device maythereby be provided with added functionality, improved quality, reducedcomplexity, and/or reduced cost as compared to other cameras (e.g., thedigital point-and-shoot cameras and the single-lens reflex camerasdescribed above).

FIGS. 1A-D are isometric views of an example of an image capture device100. The image capture device 100 may include a body 102 having a lens104 structured on a front surface of the body 102, various indicators onthe front of the surface of the body 102 (such as LEDs, displays, andthe like), various input mechanisms (such as buttons, switches, andtouch-screen mechanisms), and electronics (e.g., imaging electronics,power electronics, etc.) internal to the body 102 for capturing imagesvia the lens 104 and/or performing other functions. The image capturedevice 100 may be configured to capture images and video and to storecaptured images and video for subsequent display or playback.

The image capture device 100 may include various indicators, includingLED lights 106 and LCD display 108. The image capture device 100 mayalso include buttons 110 configured to allow a user of the image capturedevice 100 to interact with the image capture device 100, to turn theimage capture device 100 on, to operate latches or hinges associatedwith doors of the image capture device 100, and/or to otherwiseconfigure the operating mode of the image capture device 100. The imagecapture device 100 may also include a microphone 112 configured toreceive and record audio signals in conjunction with recording video.

The image capture device 100 may include an I/O interface 114 (e.g.,hidden as indicated using dotted lines). As best shown in FIG. 1B, theI/O interface 114 can be covered and sealed by a removable door 115 ofthe image capture device 100. The removable door 115 can be secured, forexample, using a latch mechanism 115 a (e.g., hidden as indicated usingdotted lines) that is opened by engaging the associated button 110 asshown.

The removable door 115 can also be secured to the image capture device100 using a hinge mechanism 115 b, allowing the removable door 115 topivot between an open position allowing access to the I/O interface 114and a closed position blocking access to the I/O interface 114. Theremovable door 115 can also have a removed position (not shown) wherethe entire removable door 115 is separated from the image capture device100, that is, where both the latch mechanism 115 a and the hingemechanism 115 b allow the removable door 115 to be removed from theimage capture device 100.

The image capture device 100 may also include another microphone 116integrated into the body 102 or housing. The front surface of the imagecapture device 100 may include two drainage ports as part of a drainagechannel 118. The image capture device 100 may include an interactivedisplay 120 that allows for interaction with the image capture device100 while simultaneously displaying information on a surface of theimage capture device 100. As illustrated, the image capture device 100may include the lens 104 that is configured to receive light incidentupon the lens 104 and to direct received light onto an image sensorinternal to the lens 104.

The image capture device 100 of FIGS. 1A-D includes an exterior thatencompasses and protects internal electronics. In the present example,the exterior includes six surfaces (i.e. a front face, a left face, aright face, a back face, a top face, and a bottom face) that form arectangular cuboid. Furthermore, both the front and rear surfaces of theimage capture device 100 are rectangular. In other embodiments, theexterior may have a different shape. The image capture device 100 may bemade of a rigid material such as plastic, aluminum, steel, orfiberglass. The image capture device 100 may include features other thanthose described here. For example, the image capture device 100 mayinclude additional buttons or different interface features, such asinterchangeable imaging modules, cold shoes, or hot shoes that addfunctional accessories, etc.

The image capture device 100 may include various types of image sensors,such as a charge-coupled device (CCD) sensors, active pixel sensors(APS), complementary metal-oxide-semiconductor (CMOS) sensors, N-typemetal-oxide-semiconductor (NMOS) sensors, and/or any other image sensoror combination of image sensors.

Although not illustrated, in various embodiments, the image capturedevice 100 may include other additional electrical components (e.g., animage processor, camera SoC (system-on-chip), etc.), which may beincluded on one or more circuit boards within the body 102 of the imagecapture device 100.

The image capture device 100 may interface with or communicate with anexternal device, such as an external user interface device, via a wiredor wireless computing communication link (e.g., the I/O interface 114).The user interface device may, for example, be the personal computingdevice 360 described below with respect to FIG. 3B. Any number ofcomputing communication links may be used. The computing communicationlink may be a direct computing communication link or an indirectcomputing communication link, such as a link including another device ora network, such as the internet, may be used.

In some implementations, the computing communication link may be a Wi-Filink, an infrared link, a Bluetooth (BT) link, a cellular link, a ZigBeelink, a near field communications (NFC) link, such as an ISO/IEC 20643protocol link, an Advanced Network Technology interoperability (ANT+)link, and/or any other wireless communications link or combination oflinks.

In some implementations, the computing communication link may be an HDMIlink, a USB link, a digital video interface link, a display portinterface link, such as a Video Electronics Standards Association (VESA)digital display interface link, an Ethernet link, a Thunderbolt link,and/or other wired computing communication link.

The image capture device 100 may transmit images, such as panoramicimages, or portions thereof, to the user interface device (not shown)via the computing communication link, and the user interface device maystore, process, display, or a combination thereof the panoramic images.

The user interface device may be a computing device, such as asmartphone, a tablet computer, a phablet, a smart watch, a portablecomputer, and/or another device or combination of devices configured toreceive user input, communicate information with the image capturedevice 100 via the computing communication link, or receive user inputand communicate information with the image capture device 100 via thecomputing communication link.

The user interface device may display, or otherwise present, content,such as images or video, acquired by the image capture device 100. Forexample, a display of the user interface device may be a viewport intothe three-dimensional space represented by the panoramic images or videocaptured or created by the image capture device 100.

The user interface device may communicate information, such as metadata,to the image capture device 100. For example, the user interface devicemay send orientation information of the user interface device withrespect to a defined coordinate system to the image capture device 100,such that the image capture device 100 may determine an orientation ofthe user interface device relative to the image capture device 100.

Based on the determined orientation, the image capture device 100 mayidentify a portion of the panoramic images or video captured by theimage capture device 100 for the image capture device 100 to send to theuser interface device for presentation as the viewport. In someimplementations, based on the determined orientation, the image capturedevice 100 may determine the location of the user interface deviceand/or the dimensions for viewing of a portion of the panoramic imagesor video.

The user interface device may implement or execute one or moreapplications to manage or control the image capture device 100. Forexample, the user interface device may include an application forcontrolling camera configuration, video acquisition, video display, orany other configurable or controllable aspect of the image capturedevice 100.

The user interface device, such as via an application, may generate andshare, such as via a cloud-based or social media service, one or moreimages, or short video clips, such as in response to user input. In someimplementations, the user interface device, such as via an application,may remotely control the image capture device 100 such as in response touser input.

The user interface device, such as via an application, may displayunprocessed or minimally processed images or video captured by the imagecapture device 100 contemporaneously with capturing the images or videoby the image capture device 100, such as for shot framing, which may bereferred to herein as a live preview, and which may be performed inresponse to user input. In some implementations, the user interfacedevice, such as via an application, may mark one or more key momentscontemporaneously with capturing the images or video by the imagecapture device 100, such as with a tag, such as in response to userinput.

The user interface device, such as via an application, may display, orotherwise present, marks or tags associated with images or video, suchas in response to user input. For example, marks may be presented in acamera roll application for location review and/or playback of videohighlights.

The user interface device, such as via an application, may wirelesslycontrol camera software, hardware, or both. For example, the userinterface device may include a web-based graphical interface accessibleby a user for selecting a live or previously recorded video stream fromthe image capture device 100 for display on the user interface device.

The user interface device may receive information indicating a usersetting, such as an image resolution setting (e.g., 3840 pixels by 2160pixels), a frame rate setting (e.g., 60 frames per second (fps)), alocation setting, and/or a context setting, which may indicate anactivity, such as mountain biking, in response to user input, and maycommunicate the settings, or related information, to the image capturedevice 100.

The image capture device 100 may be modular and/or configurable usingthe implementations described in this disclosure, such as theembodiments and implementations described in FIGS. 5-11 and may be usedto implement some or all of the techniques described in this disclosure,such as the technique described in FIG. 12.

FIGS. 2A-B illustrate another example of an image capture device 200.The image capture device 200 includes a body 202 and two camera lenses204, 206 disposed on opposing surfaces of the body 202, for example, ina back-to-back or Janus configuration.

The image capture device may include electronics (e.g., imagingelectronics, power electronics, etc.) internal to the body 202 forcapturing images via the lenses 204, 206 and/or performing otherfunctions. The image capture device may include various indicators suchas an LED light 212 and an LCD display 214.

The image capture device 200 may include various input mechanisms suchas buttons, switches, and touchscreen mechanisms. For example, the imagecapture device 200 may include buttons 216 configured to allow a user ofthe image capture device 200 to interact with the image capture device200, to turn the image capture device 200 on, and to otherwise configurethe operating mode of the image capture device 200. In animplementation, the image capture device 200 includes a shutter buttonand a mode button. It should be appreciated, however, that, in alternateembodiments, the image capture device 200 may include additional buttonsto support and/or control additional functionality.

The image capture device 200 may also include one or more microphones218 configured to receive and record audio signals (e.g., voice or otheraudio commands) in conjunction with recording video.

The image capture device 200 may include an I/O interface 220 and aninteractive display 222 that allows for interaction with the imagecapture device 200 while simultaneously displaying information on asurface of the image capture device 200.

The image capture device 200 may be made of a rigid material such asplastic, aluminum, steel, or fiberglass. In some embodiments, the imagecapture device 200 described herein includes features other than thosedescribed. For example, instead of the I/O interface 220 and theinteractive display 222, the image capture device 200 may includeadditional interfaces or different interface features, such asinterchangeable imaging modules, cold shoes, or hot shoes that addfunctional accessories, etc.

FIG. 2C is a cross-sectional view of the image capture device 200 ofFIGS. 2A-B. The image capture device 200 is configured to capturespherical images, and accordingly, includes a first image capture device224 and a second image capture device 226. The first image capturedevice 224 defines a first field-of-view 228 as shown in FIG. 2C andincludes the lens 204 that receives and directs light onto a first imagesensor 230.

Similarly, the second image capture device 226 defines a secondfield-of-view 232 as shown in FIG. 2C and includes the lens 206 thatreceives and directs light onto a second image sensor 234. To facilitatethe capture of spherical images, the image capture devices 224, 226 (andrelated components) may be arranged in a back-to-back (Janus)configuration such that the lenses 204, 206 face in generally oppositedirections.

The fields-of-view 228, 232 of the lenses 204, 206 are shown above andbelow boundaries 236, 238, respectively. Behind the first lens 204, thefirst image sensor 230 may capture a first hyper-hemispherical imageplane from light entering the first lens 204, and behind the second lens206, the second image sensor 234 may capture a secondhyper-hemispherical image plane from light entering the second lens 206.

One or more areas, such as blind spots 240, 242 may be outside of thefields-of-view 228, 232 of the lenses 204, 206 so as to define a “deadzone.” In the dead zone, light may be obscured from the lenses 204, 206and the corresponding image sensors 230, 234, and content in the blindspots 240, 242 may be omitted from capture. In some implementations, theimage capture devices 224, 226 may be configured to minimize the blindspots 240, 242.

The fields-of-view 228, 232 may overlap. Stitch points 244, 246,proximal to the image capture device 200, at which the fields-of-view228, 232 overlap may be referred to herein as overlap points or stitchpoints. Content captured by the respective lenses 204, 206, distal tothe stitch points 244, 246, may overlap.

Images contemporaneously captured by the respective image sensors 230,234 may be combined to form a combined image. Combining the respectiveimages may include correlating the overlapping regions captured by therespective image sensors 230, 234, aligning the captured fields-of-view228, 232, and stitching the images together to form a cohesive combinedimage.

A slight change in the alignment, such as position and/or tilt, of thelenses 204, 206, the image sensors 230, 234, or both, may change therelative positions of their respective fields-of-view 228, 232 and thelocations of the stitch points 244, 246. A change in alignment mayaffect the size of the blind spots 240, 242, which may include changingthe size of the blind spots 240, 242 unequally.

Incomplete or inaccurate information indicating the alignment of theimage capture devices 224, 226, such as the locations of the stitchpoints 244, 246, may decrease the accuracy, efficiency, or both ofgenerating a combined image. In some implementations, the image capturedevice 200 may maintain information indicating the location andorientation of the lenses 204, 206 and the image sensors 230, 234 suchthat the fields-of-view 228, 232, stitch points 244, 246, or both may beaccurately determined, which may improve the accuracy, efficiency, orboth of generating a combined image.

The lenses 204, 206 may be laterally offset from each other, may beoff-center from a central axis of the image capture device 200, or maybe laterally offset and off-center from the central axis. As compared toimage capture devices with back-to-back lenses, such as lenses alignedalong the same axis, image capture devices including laterally offsetlenses may include substantially reduced thickness relative to thelengths of the lens barrels securing the lenses. For example, theoverall thickness of the image capture device 200 may be close to thelength of a single lens barrel as opposed to twice the length of asingle lens barrel as in a back-to-back configuration. Reducing thelateral distance between the lenses 204, 206 may improve the overlap inthe fields-of-view 228, 232.

Images or frames captured by the image capture devices 224, 226 may becombined, merged, or stitched together to produce a combined image, suchas a spherical or panoramic image, which may be an equirectangularplanar image. In some implementations, generating a combined image mayinclude three-dimensional, or spatiotemporal, noise reduction (3DNR). Insome implementations, pixels along the stitch boundary may be matchedaccurately to minimize boundary discontinuities.

The image capture device 200 may be modular and/or configurable usingthe implementations described in this disclosure, such as theembodiments and implementations described in FIGS. 5-11 and may be usedto implement some or all of the techniques described in this disclosure,such as the technique described in FIG. 12.

FIGS. 3A-B are block diagrams of examples of image capture systems.

Referring first to FIG. 3A, an image capture system 300 is shown. Theimage capture system 300 includes an image capture device 310 (e.g., acamera or a drone), which may, for example, be the image capture device200 shown in FIGS. 2A-C.

The image capture device 310 includes a processing apparatus 312 that isconfigured to receive a first image from a first image sensor 314 andreceive a second image from a second image sensor 316. The image capturedevice 310 includes a communications interface 318 for transferringimages to other devices. The image capture device 310 includes a userinterface 320 to allow a user to control image capture functions and/orview images. The image capture device 310 includes a battery 322 forpowering the image capture device 310. The components of the imagecapture device 310 may communicate with each other via the bus 324.

The processing apparatus 312 may be configured to perform image signalprocessing (e.g., filtering, tone mapping, stitching, and/or encoding)to generate output images based on image data from the image sensors 314and 316. The processing apparatus 312 may include one or more processorshaving single or multiple processing cores. The processing apparatus 312may include memory, such as a random-access memory device (RAM), flashmemory, or another suitable type of storage device such as anon-transitory computer-readable memory. The memory of the processingapparatus 312 may include executable instructions and data that can beaccessed by one or more processors of the processing apparatus 312.

For example, the processing apparatus 312 may include one or moredynamic random access memory (DRAM) modules, such as double data ratesynchronous dynamic random-access memory (DDR SDRAM). In someimplementations, the processing apparatus 312 may include a digitalsignal processor (DSP). In some implementations, the processingapparatus 312 may include an application specific integrated circuit(ASIC). For example, the processing apparatus 312 may include a customimage signal processor.

The first image sensor 314 and the second image sensor 316 may beconfigured to detect light of a certain spectrum (e.g., the visiblespectrum or the infrared spectrum) and convey information constitutingan image as electrical signals (e.g., analog or digital signals). Forexample, the image sensors 314 and 316 may include CCDs or active pixelsensors in a CMOS. The image sensors 314 and 316 may detect lightincident through a respective lens (e.g., a fisheye lens). In someimplementations, the image sensors 314 and 316 include digital-to-analogconverters. In some implementations, the image sensors 314 and 316 areheld in a fixed orientation with respective fields of view that overlap.

The communications interface 318 may enable communications with apersonal computing device (e.g., a smartphone, a tablet, a laptopcomputer, or a desktop computer). For example, the communicationsinterface 318 may be used to receive commands controlling image captureand processing in the image capture device 310. For example, thecommunications interface 318 may be used to transfer image data to apersonal computing device. For example, the communications interface 318may include a wired interface, such as a high-definition multimediainterface (HDMI), a universal serial bus (USB) interface, or a FireWireinterface. For example, the communications interface 318 may include awireless interface, such as a Bluetooth interface, a ZigBee interface,and/or a Wi-Fi interface.

The user interface 320 may include an LCD display for presenting imagesand/or messages to a user. For example, the user interface 320 mayinclude a button or switch enabling a person to manually turn the imagecapture device 310 on and off. For example, the user interface 320 mayinclude a shutter button for snapping pictures.

The battery 322 may power the image capture device 310 and/or itsperipherals. For example, the battery 322 may be charged wirelessly orthrough a micro-USB interface.

The image capture system 300 may be modular and/or configurable usingthe implementations described in this disclosure, such as theembodiments and implementations described in FIGS. 5-11 and may be usedto implement some or all of the techniques described in this disclosure,such as the technique described in FIG. 12.

Referring to FIG. 3B, another image capture system 330 is shown. Theimage capture system 330 includes an image capture device 340 and apersonal computing device 360 that communicate via a communications link350. The image capture device 340 may, for example, be the image capturedevice 100 shown in FIGS. 1A-D. The personal computing device 360 may,for example, be the user interface device described with respect toFIGS. 1A-D.

The image capture device 340 includes an image sensor 342 that isconfigured to capture images. The image capture device 340 includes acommunications interface 344 configured to transfer images via thecommunication link 350 to the personal computing device 360.

The personal computing device 360 includes a processing apparatus 362that is configured to receive, using a communications interface 366,images from the image sensor 342. The processing apparatus 362 may beconfigured to perform image signal processing (e.g., filtering, tonemapping, stitching, and/or encoding) to generate output images based onimage data from the image sensor 342.

The image sensor 342 is configured to detect light of a certain spectrum(e.g., the visible spectrum or the infrared spectrum) and conveyinformation constituting an image as electrical signals (e.g., analog ordigital signals). For example, the image sensor 342 may include CCDs oractive pixel sensors in a CMOS. The image sensor 342 may detect lightincident through a respective lens (e.g., a fisheye lens). In someimplementations, the image sensor 342 includes digital-to-analogconverters. Image signals from the image sensor 342 may be passed toother components of the image capture device 340 via a bus 346.

The communications link 350 may be a wired communications link or awireless communications link. The communications interface 344 and thecommunications interface 366 may enable communications over thecommunications link 350. For example, the communications interface 344and the communications interface 366 may include an HDMI port or otherinterface, a USB port or other interface, a FireWire interface, aBluetooth interface, a ZigBee interface, and/or a Wi-Fi interface. Forexample, the communications interface 344 and the communicationsinterface 366 may be used to transfer image data from the image capturedevice 340 to the personal computing device 360 for image signalprocessing (e.g., filtering, tone mapping, stitching, and/or encoding)to generate output images based on image data from the image sensor 342.

The processing apparatus 362 may include one or more processors havingsingle or multiple processing cores. The processing apparatus 362 mayinclude memory, such as RAM, flash memory, or another suitable type ofstorage device such as a non-transitory computer-readable memory. Thememory of the processing apparatus 362 may include executableinstructions and data that can be accessed by one or more processors ofthe processing apparatus 362. For example, the processing apparatus 362may include one or more DRAM modules, such as DDR SDRAM.

In some implementations, the processing apparatus 362 may include a DSP.In some implementations, the processing apparatus 362 may include anintegrated circuit, for example, an ASIC. For example, the processingapparatus 362 may include a custom image signal processor. Theprocessing apparatus 362 may exchange data (e.g., image data) with othercomponents of the personal computing device 360 via a bus 368.

The personal computing device 360 may include a user interface 364. Forexample, the user interface 364 may include a touchscreen display forpresenting images and/or messages to a user and receiving commands froma user. For example, the user interface 364 may include a button orswitch enabling a person to manually turn the personal computing device360 on and off In some implementations, commands (e.g., start recordingvideo, stop recording video, or capture photo) received via the userinterface 364 may be passed on to the image capture device 340 via thecommunications link 350.

The image capture system 330 may be modular and/or configurable usingthe implementations described in this disclosure, such as theembodiments and implementations described in FIGS. 5-11 and may be usedto implement some or all of the techniques described in this disclosure,such as the technique described in FIG. 12.

FIG. 4A is a perspective view of another example of an image capturedevice 400 together with an associated field-of-view and FIG. 4B is aschematic representation of the image capture device 400. The imagecapture device 400 includes one or more optical components or elements405 with an associated field-of-view 410 that extends, for example, 90°in a lateral dimension X-X and 120° in a longitudinal dimension Y-Y.Dependent upon the capabilities of the particular optical component(s)405, however, the extent of the field-of-view 410 may be varied (i.e.,increased or decreased) in the lateral dimension or the longitudinaldimension. Suitable optical component(s) 405 may include one or morelenses, macro lenses, zoom lenses, special-purpose lenses, telephotolenses, prime lenses, achromatic lenses, apochromatic lenses, processlenses, wide-angle lenses, ultra-wide-angle lenses, fisheye lenses,infrared lenses, ultraviolet lenses, spherical lenses, and perspectivecontrol lenses. In some image capture devices, multiple, overlappingfields of view are employed to increase the capability of the device,for example, by including two or more optical elements. For example, afirst fisheye image may be a round or elliptical image, and may betransformed into a first rectangular image; a second fisheye image maybe a round or elliptical image, and may be transformed into a secondrectangular image; and the first and second rectangular images may bearranged side-by-side, which may include overlapping, and stitchedtogether to form the equirectangular planar image.

As seen in FIG. 4 in addition to the optical component(s) 405, the imagecapture device 400 may further include an audio component 415, a userinterface (UI) unit 420, an input/output (I/O) unit 425, a sensorcontroller 430, a processor 435, an electronic storage unit 440, animage sensor 445, a metadata unit 450, an optics unit 455, acommunication unit 460, an encoder 465, and power system 470. Suitableexamples of the image sensor 445 may include a charge-coupled device(CCD) sensor, an active pixel sensor (APS), a complementary metal-oxidesemiconductor (CMOS) sensor, an N-type metal-oxide-semiconductor (NMOS)sensor, and/or any other image sensor or combination of image sensors.

During the processing of images, it is envisioned that the processor 435may identify motion information, such as motion vectors, representingmotion between the respective images and reference data. For example,the processor 435 may perform motion estimation to generate the motioninformation. The processor 435 may then output the processed images, forexample, to a memory of the image capture device 400 for storage.

The image capture device 400 may be modular and/or configurable usingthe implementations described in this disclosure, such as theembodiments and implementations described in FIGS. 5-11 and may be usedto implement some or all of the techniques described in this disclosure,such as the technique described in FIG. 12.

FIG. 5 is a diagram of an image capture system 500 including an imagecapture device 510 having an attached integrated sensor-opticalcomponent accessory 520. The integrated sensor-optical componentaccessory 520 includes a body 560, one or more optical components 565structured on the body 560, one or more image sensors 570 internal tothe body 560, and an interface mounting structure 575. The one or moreimage sensors 570 and the one or more optical components 565 may form anintegrated sensor-optical component assembly of the integratedsensor-optical component accessory 520. Although shown as including asingle sensor 570 and a single optical component 565 in the embodimentshown in FIG. 5, in alternate embodiments, the number of includedsensors 570 and optical components 565 may be varied without departingfrom the scope of the present disclosure.

The one or more image sensors 570 may include any or all features and/orcharacteristics described with respect to FIGS. 1-4. For example, one ormore image sensors 570 may include various types of image sensors, suchas a charge-coupled device (CCD) sensors, active pixel sensors (APS),complementary metal-oxide-semiconductor (CMOS) sensors, N-typemetal-oxide-semiconductor (NMOS) sensors, and/or any other image sensoror combination of image sensors.

The one or more optical components 565 may include any or all featuresand/or characteristics described with respect to FIGS. 1-4. For example,the one or more optical components 565 may include one or more lenses,macro lenses, zoom lenses, special-purpose lenses, telephoto lenses,prime lenses, achromatic lenses, apochromatic lenses, process lenses,wide-angle lenses, ultra-wide-angle lenses, fisheye lenses, infraredlenses, ultraviolet lenses, perspective control lenses, and/or any otherlens(es) and/or combinations thereof.

The interface mounting structure 575 may include mechanical clips, adetent assembly, slots, or the like that correspond to an interfacemounting structure 550 included on the image capture device 510 asdescribed herein. As further described herein, the interface mountingstructure 575 may include electrical, optical and other like interfacingmechanisms to transfer data, provide power and the like between theimage capture device 510 and the integrated sensor-optical componentaccessory 520. The interface mounting structure 550 and the interfacemounting structure 575 may be any of the interfaces described herein, asapplicable and appropriate.

In an implementation, the integrated sensor-optical component accessory520 may draw power from the image capture device 510, for example, froma power source 547, such as a battery. In an implementation, theintegrated sensor-optical component accessory 520 may draw power from analternate power source 577 included on the integrated sensor-opticalcomponent accessory 520, e.g., one or more separate batteries. In animplementation, the integrated sensor-optical component accessory 520may draw power from a combination of the above implementations or powersources.

In an implementation, the integrated sensor-optical component accessory520 may include other sensors and/or devices such as microphones,processors, power supply, motion sensors, audio sensors, and the like.

The image capture device 510 includes a body 530, one or more opticalcomponents 535 structured on the body 530, one or more image sensors 540internal to the body 530, a processor 545 internal to the body 530 andan interface mounting structure 550. In an implementation, the one ormore optical components 535 structured on the body 530 and the one ormore image sensors 540 are fixed with respect to the image capturedevice 510. The image capture device 510 may include any or all featuresand/or characteristics described with respect to FIGS. 1-4. Althoughshown as including a single sensor 540 and a single optical component535 in the embodiment shown in FIG. 5, in alternate embodiments, thenumber of included sensors 540 and optical components 535 may be variedwithout departing from the scope of the present disclosure.

The one or more image sensors 540 may include any or all features and/orcharacteristics described with respect to FIGS. 1-4. For example, one ormore image sensors 540 may include various types of image sensors, suchas a charge-coupled device (CCD) sensors, active pixel sensors (APS),complementary metal-oxide-semiconductor (CMOS) sensors, N-typemetal-oxide-semiconductor (NMOS) sensors, and/or any other image sensoror combination of image sensors.

The one or more optical components 535 may include any or all featuresand/or characteristics described with respect to FIGS. 1-4. For example,the one or more optical components 535 may include one or more lenses,macro lenses, zoom lenses, special-purpose lenses, telephoto lenses,prime lenses, achromatic lenses, apochromatic lenses, process lenses,wide-angle lenses, ultra-wide-angle lenses, fisheye lenses, infraredlenses, ultraviolet lenses, perspective control lenses, and/or any otherlens(es) and/or combinations thereof.

The interface mounting structure 550 may include mechanical clips, adetent assembly, slots, or the like that receive corresponding structureincluded on the integrated sensor-optical component accessory 520. Asfurther described herein, the interface mounting structure 550 mayinclude electrical, optical and other like interfacing mechanisms totransfer data, provide power and the like between the image capturedevice 510 and the integrated sensor-optical component accessory 520.The interface mounting structure 550 may facilitate the use of a varietyof integrated sensor-optical component accessories 520.

In an implementation, data is communicated between the integratedsensor-optical component accessory 520 and the image capture device 510when the integrated sensor-optical component accessory 520 and the imagecapture device 510 are connected. In an implementation, the integratedsensor-optical component accessory 520 and the image capture device 510are physically connected via the interface mounting structure 575 andthe interface mounting structure 550. In an implementation, the datatransfer may be bi-directional. In an implementation, the volume of dataflowing from the integrated sensor-optical component accessory 520 tothe image capture device 510 may exceed the volume of data flowing fromthe image capture device 510 to the integrated sensor-optical componentaccessory 520.

In an implementation, the data may include integrated sensor-opticalcomponent accessory identification data or information, changes inshutter speed, exposure, and the like. In an implementation, theintegrated sensor-optical component accessory identification data may becontrol data or information for use by the processor 545 to reconfigureoperation and functionality of the image capture system 500 includingcontrol or operational control of the integrated sensor-opticalcomponent accessory 520 and the image capture device 510.

In an implementation, the integrated sensor-optical component accessoryidentification data may include lens shading, distortion, white balance,pixel defects, color, and chromatic aberration. Such characteristics maybe assessed and image correction information may be determined therefor.For example, for each image sensor/optical component pair, the imagecorrection information may include one or more of a lens shadingcorrection table, a distortion correction table, a white balancecorrection table, a pixel defect table or map, a color correction tableor matrix, or a chromatic aberration correction table. The one or moreimage correction information may be stored locally by the integratedsensor-optical component 520 and be transferred to the image capturedevice 510 for processing of image data received thereby. In animplementation, the integrated sensor-optical component accessoryidentification data may be stored on memory (such as for example storage440 in FIG. 4) located in the integrated sensor-optical componentaccessory 520.

The integrated sensor-optical component accessory identification datastored by the integrated sensor-optical component accessory 520 mayinclude various types of information associated with the integratedsensor-optical component accessory 520, such as the image correctioninformation (described above), integrated sensor-optical componentcontrol information, and/or security information, which may be used bythe image capture device 510. The image correction information (e.g.,one or more image correction tables) may be used by the image capturedevice 510 when processing and/or storing image data. The image modulecontrol information may be used by the image capture device 510 forcontrolling operation of the integrated sensor-optical componentaccessory 520 with the image capture device 510. For example, the imagemodule control information may include software programming enablingcontrol of various functions of the integrated sensor-optical componentaccessory 520 not previously stored by the image capture device 510. Forinstance, the image capture device 510 may already include (e.g., bepreprogrammed with) integrated sensor-optical component accessorycontrol information for operation of an integrated sensor-opticalcomponent accessory 520 having certain configurations (e.g., specificcombinations of primary sensor characteristics and primary lenscharacteristics), certain components, or certain features (e.g.,mechanical zoom, sensors), but may not include image control informationrequired for operation of other configurations, other components, orother features. Security information may include, for example, digitalrights management (DRM) security protocols that permit use of theintegrated sensor-optical component accessory 520 with the image capturedevice 510. The integrated sensor-optical component accessoryinformation may be transferred from the integrated sensor-opticalcomponent accessory 520 and thereafter be stored by the image capturedevice 510 (e.g., a memory thereof), and thereafter be used by the imagecapture device 510 for controlling or operating the integratedsensor-optical component accessory 520. In an implementation, thisinformation may be the identification data or a part thereof. In animplementation, this data may be used to reconfigure the processor, SoC,controller, image signal processor or image capture device for optimaloperation with the integrated sensor-optical component accessory 520.

In an implementation, the interface mounting structure 550 and theinterface mounting structure 575 may implement a wireless dataconnection, conductive power connection and a mechanical connection. Forexample, the mechanical connection mechanically connects the imagecapture device 510 to the integrated sensor-optical component accessory520 to prevent physical separation therebetween, for example, by holdingthe image capture device 510 in a predetermined spatial relationshiprelative to the integrated sensor-optical component accessory 520. Thewireless data connection provides wireless data transfer, such astransfer of image information (e.g., images frames of a video stream)from the integrated sensor-optical component accessory 520 to the imagecapture device 510. For example, the image information may includeincludes image frames having 4K resolution or more and captured at 30frames per second or more.

The wireless data connection may be a close proximity, high speed datatransfer system that provides data transmission without physical contactbetween wireless data transfer devices thereof. A conductive powerconnection transfers electrical power to the integrated sensor-opticalcomponent accessory 520 from the image capture device 510 via physicalcontact between conductive members, which is then used to power variouselectrical components of the integrated sensor-optical componentaccessory 520. The wireless data connection may also be referred to as adata connection, a wireless data link, a data link, a wireless datacoupling, or a data coupling. The conductive power connection may alsobe referred to as a power connection, a conductive power link, a powerlink, a conductive power coupling, or a power coupling. The mechanicalconnection may also be referred to as a physical connection, amechanical coupling, or a physical coupling. In some embodiments, awired data connection may be provided instead of or in addition to thewireless data connection, for example, to transfer subsets or particulartypes of data (e.g., control instructions). Instead of or in addition tothe conductive power connection, a wireless power connection may beprovided (e.g., inductive power transfer).

The processor 545 may be a system-on-chip, image signal processor, acontroller or combinations thereof which are configured for optimalperformance based on identification data provided by the integratedsensor-optical component accessory 520. As described herein, the imagecapture device 510 may be calibrated based on identification dataprovided by the integrated sensor-optical component accessories 520. Inan implementation, a user interface is configurable based on theidentification data.

In an implementation, the processor 545 may be adapted and programmed tosupport multiple integrated sensor-optical component accessories 520 andproduct uses, such as, for example, hand-held applications, drone-basedapplications, and/or vehicle-based applications. The processor 545 maybe configured for use with a variety of integrated sensor-opticalcomponent accessories 520. Each integrated sensor-optical componentaccessory 520 may include specific identification data or identifiersthat may be communicated to the processor 545. The identification datamay provide information concerning particular fields of view of specificoptical components, image sensors, and the like. Once the integratedsensor-optical component accessory 520 is identified and processed bythe processor 545, the processor 545 may execute a self-calibrationbased on the identification data. The image capture device 510 and theprocessor 545 may be configured or loaded with multiple firmware sets tofacilitate the calibration process.

In an implementation, the processor 545 may reconfigure operation of theimage capture device including the processor 545 to process imageinformation captured via the integrated sensor-optical componentaccessory 520 instead of the one or more optical components 535 and theone or more image sensors 540 of the image capture device 510. In animplementation, image information from the one or more opticalcomponents 535 and the one or more image sensors 540 of the imagecapture device 510 may be ignored. In an implementation, the processor545 may turn off or power down operation of the one or more opticalcomponents 535 and the one or more image sensors 540 of the imagecapture device 510.

In an implementation, the processor 545 may reconfigure operation of theimage capture device including the processor 545 to process imageinformation captured via the integrated sensor-optical componentaccessory 520 and image information captured by the one or more opticalcomponents 535 and the one or more image sensors 540 of the imagecapture device 510. In an implementation, image information from theintegrated sensor-optical component accessory 520 and from the one ormore optical components 535 and the one or more image sensors 540 of theimage capture device 510 are processed appropriately, by an imageprocessor, for example.

In an implementation, the processor 545 may reconfigure operation of theimage capture device including the processor 545 to process imageinformation captured via the integrated sensor-optical componentaccessory 520 and/or image information captured by the one or moreoptical components 535 and the one or more image sensors 540 of theimage capture device 510 based on where and how the integratedsensor-optical component accessory 520 is connected to the image capturedevice 510. For example, the integrated sensor-optical componentaccessory 520 may be attached at different surfaces of the image capturedevice and each surface or interface port may include an attachmentidentifier that may be processed by the processor 545. In animplementation, mechanical mechanisms, electrical mechanisms, opticalmechanisms and/or a combination of such mechanism may be used toprovide, generate or otherwise inform the processor 545 of theattachment identifier. In an implementation, image information from theintegrated sensor-optical component accessory 520 and from the one ormore optical components 535 and the one or more image sensors 540 of theimage capture device 510 are processed appropriately, by an imageprocessor, for example.

In an implementation, the processor 545 may use the integratedsensor-optical component accessory identification information,attachment identifier, mounting information and/or a combination thereofto reconfigure functionality and/or operation of the processor 545 andthe image capture device 510.

FIG. 6 is a diagram of an image capture system 600 including an imagecapture device 610 with an attached integrated sensor-optical componentaccessory 620 using an interface structure or frame 680. The imagecapture device 610 and the integrated sensor-optical component accessory620 may include any or all features and/or characteristics describedwith respect to FIGS. 1-5 and the description of the image capturedevice 610 and the integrated sensor-optical component accessory 620 istherefore summarized herein.

The integrated sensor-optical component accessory 620 includes a body660, one or more optical components 665 structured on the body 660, oneor more image sensors 670 internal to the body 660, and an interfacemounting structure 675. The one or more image sensors 670 and the one ormore optical components 665 may form an integrated sensor-opticalcomponent assembly of the integrated sensor-optical component accessory620.

The image capture device 610 includes a body 630, one or more opticalcomponents 635 structured on the body 630, one or more image sensors 640internal to the body 630, a processor 645 internal to the body 630 andan interface mounting structure 650. In an implementation, the one ormore optical components 635 structured on the body 630 and the one ormore image sensors 640 are fixed with respect to the image capturedevice 610. The image capture device 610 may include a power source 647.

In an implementation, attachment of the image capture device 610 and theintegrated sensor-optical component accessory 620 may use the interfacestructure or frame 680. The interface structure 680 may providemechanical cooperation with the image capture device 610 and electricalcommunication between the integrated sensor-optical component accessory620 and the image capture device 610. In an implementation, theinterface structure 680 may assist in data transfer between the imagecapture device 610 and the integrated sensor-optical component accessory620. The interface structure 680 may include or be the implementationsdescribed in U.S. patent application Ser. No. 15/892,077, filed on Feb.8, 2018, which is herein incorporated by reference.

In an implementation, the interface structure 680 may be adapted forelectrical connection and signal communication between the image capturedevice 610 and the integrated sensor-optical component accessory 620 tofacilitate the transfer of data and/or power between the image capturedevice 610 and the integrated sensor-optical component accessory 620. Inan implementation, the interface structure 680 may a mounting structurethat is configured and dimensioned for engagement/disengagement with theinterface mounting structure 650 of the image capture device 610 tofacilitate attachment/de-attachment of the integrated sensor-opticalcomponent accessory 620 to the image capture device 610.

In an implementation, the integrated sensor-optical component accessory620 may draw power from the image capture device 610, for example, froma power source 647, such as a battery, which may be facilitated by theelectrical connection established by the interface structure 680. In animplementation, the integrated sensor-optical component accessory 620may draw power from an alternate power source 677 included on theintegrated sensor-optical component accessory 620, e.g., one or moreseparate batteries. In an implementation, the integrated sensor-opticalcomponent accessory 620 may draw power from a power source 687 includedon the interface structure 680. In an implementation, the integratedsensor-optical component accessory 620 may draw power from a combinationof the above implementations or power sources.

FIG. 7 is a diagram of an image capture system 700 including an imagecapture device 710 with an attached integrated sensor-optical componentaccessory 720 using a cable 790. The image capture device 710 and theintegrated sensor-optical component accessory 720 may include any or allfeatures and/or characteristics described with respect to FIGS. 1-6 andthe description of the image capture device 710 and the integratedsensor-optical component accessory 720 is therefore summarized herein.The cable 790 may be any of a variety of data cables, video cables,audio cables, and/or combination thereof, and may be, but is not limitedto, High-Definition Multimedia Interface (HDMI), IEEE 1394 FireWire,Digital Visual Interface (DVI), Universal Serial Bus (USB), Thunderbolt,DisplayPort, and includes all versions and types thereof.

The integrated sensor-optical component accessory 720 includes a body760, one or more optical components 765 structured on the body 760, oneor more image sensors 770 internal to the body 760, and an interfacemounting structure 775. The one or more image sensors 770 and the one ormore optical components 765 may form an integrated sensor-opticalcomponent assembly of the integrated sensor-optical component accessory720.

The image capture device 710 includes a body 730, one or more opticalcomponents 735 structured on the body 730, one or more image sensors 740internal to the body 730, a processor 745 internal to the body 730 andan interface mounting structure 750. In an implementation, the one ormore optical components 735 structured on the body 730 and the one ormore image sensors 740 are fixed with respect to the image capturedevice 710. The image capture device 710 may include a power source 747.

In an implementation, attachment of the image capture device 710 and theintegrated sensor-optical component accessory 720 may use the cable 790or any like connector. The cable 790 may provide electricalcommunication between the integrated sensor-optical component accessory720 and the image capture device 710. In an implementation, the cable790 may assist in data transfer between the image capture device 710 andthe integrated sensor-optical component accessory 720.

In an implementation, the cable 790 may be adapted for electricalconnection and signal communication between the image capture device 710and the integrated sensor-optical component accessory 720 to facilitatethe transfer of data and/or power between the image capture device 710and the integrated sensor-optical component accessory 720. In animplementation, the cable 790 may be configured and dimensioned forengagement/disengagement with the interface mounting structure 750 and775 to facilitate attachment/de-attachment of the integratedsensor-optical component accessory 720 to the image capture device 710.

In an implementation, the integrated sensor-optical component accessory720 may draw power from the image capture device 710, for example, froma power source 747, such as a battery, which may be facilitated by theelectrical connection established by cable 790. In an implementation,the integrated sensor-optical component accessory 720 may draw powerfrom an alternate power source 777 included on the integratedsensor-optical component accessory 720, e.g., one or more separatebatteries. In an implementation, the integrated sensor-optical componentaccessory 720 may draw power from a combination of the aboveimplementations or power sources.

FIG. 8 is a diagram of an image capture system 800 including an imagecapture device 810 with an attached integrated sensor-optical componentaccessory 820 with multiple sensor-optical components. The image capturesystem 800 may include any or all features and/or characteristicsdescribed with respect to FIGS. 1-7. The description of the imagecapture device 810 is therefore summarized herein and the description ofthe integrated sensor-optical component accessory 820 is expandedherein.

The integrated sensor-optical component accessory 820 includes a body860, two or more optical components 865, 867 structured on the body 860,one or more image sensors 870 internal to the body 860, and an interfacemounting structure 875. The one or more image sensors 870 and the two ormore optical components 865, 867 may form an integrated sensor-opticalcomponent assembly of the integrated sensor-optical component accessory820. The two or more optical components 865, 867 of the integratedsensor-optical component accessory 820 may be the same or different andmay include any of the optical components and lenses described hereinwith respect to FIG. 5.

The image capture device 810 includes a body 830, one or more opticalcomponents 835 structured on the body 830, one or more image sensors 840internal to the body 830, a processor 845 internal to the body 830 andan interface mounting structure 850. In an implementation, the one ormore optical components 835 structured on the body 830 and the one ormore image sensors 840 are fixed with respect to the image capturedevice 810. The image capture device 810 may include a power source 847.

As described herein, the processor 845 may reconfigure operation of theimage capture device 810 including the processor 845 to process imageinformation captured via one or more of the integrated sensor-opticalcomponent accessory 820, the one or more optical components 835 and theone or more image sensors 840 of the image capture device 810. In animplementation, the processor 845 may use the integrated sensor-opticalcomponent accessory identification information, mounting informationand/or a combination thereof to reconfigure functionality and/oroperation of the processor 845 and the image capture device 810.

FIG. 9 is a diagram of an image capture system 900 including an imagecapture device 910 with multiple attached integrated sensor-opticalcomponent accessories 920, 921. The image capture system 900 may includeany or all features and/or characteristics described with respect toFIGS. 1-8. The description of the image capture device 910 and theintegrated sensor-optical component accessories 920, 921 is thereforeexpanded herein.

The integrated sensor-optical component accessories 920, 921 includes abody 960, 961, one or more optical components 965, 966 structured on thebody 960, 961, one or more image sensors 970, 971 internal to the body960, 961, and an interface mounting structure 975, 976. The one or moreimage sensors 970, 971 and the one or more optical components 965, 966may form integrated sensor-optical component assemblies of theintegrated sensor-optical component accessories 920, 921. The integratedsensor-optical component accessories 920, 921 may be the same ordifferent and may include any of the optical components and lensesdescribed herein with respect to FIG. 5.

The image capture device 910 includes a body 930, one or more opticalcomponents 935 structured on the body 930, one or more image sensors 940internal to the body 930, a processor 945 internal to the body 930 andinterface mounting structures 950, 951. In an implementation, the one ormore optical components 935 structured on the body 930 and the one ormore image sensors 940 are fixed with respect to the image capturedevice 910. The image capture device 810 may include a power source 847.

In an implementation, the integrated sensor-optical component accessory920 may be attached to image capture device 910 via interface mountingstructure 975 and interface mounting structure 950, and the integratedsensor-optical component accessory 921 may be attached to image capturedevice 910 via interface mounting structure 976 and interface mountingstructure 951. The implementation is illustrative and an integratedsensor-optical component accessory may be attached to an image capturedevice using any applicable surface. In an implementation, more than twointegrated sensor-optical component accessories may be attached. Asstated, the attachment may be implemented using any of theimplementations described herein with respect to FIGS. 1-8.

As described herein, the processor 945 may reconfigure operation of theimage capture device 910 including the processor 945 to process imageinformation captured via one or more of the integrated sensor-opticalcomponent accessories 920, 921, the one or more optical components 935and the one or more image sensors 940 of the image capture device 910.In an implementation, the processor 945 may use the integratedsensor-optical component accessory identification information, mountinginformation and/or a combination thereof to reconfigure functionalityand/or operation of the processor 945 and the image capture device 910.

FIG. 10 is a side view of a diagram of an image capture system 1000including an image capture device 1010 with an attached integratedsensor-optical component accessory 1020. The image capture system 1000may include any or all features and/or characteristics described withrespect to FIGS. 1-9. The description of the image capture device 1010and the integrated sensor-optical component accessory 1020 is thereforesummarized herein. In this implementation, a center axis of the field ofview (dashed arrow) of the image capture system 1000 and a center axisof the field of view (dashed-dotted arrow) of the integratedsensor-optical component accessory 1020 are in the same direction.

The integrated sensor-optical component accessory 1020 includes a body,one or more optical components 1065 structured on the body, one or moreimage sensors internal to the body, and an interface mounting structure.The one or more image sensors and the one or more optical components1065 may form an integrated sensor-optical component assembly of theintegrated sensor-optical component accessory 1020.

The image capture device 1010 includes a body 1030, one or more opticalcomponents 1035 structured on the body 1030, one or more image sensors1040 internal to the body 1030, a processor 1045 internal to the body1030 and an interface mounting structure. In an implementation, the oneor more optical components 1035 structured on the body 1030 and the oneor more image sensors 1040 are fixed with respect to the image capturedevice 1010.

As described herein, the processor 1045 may reconfigure operation of theimage capture device 1010 including the processor 1045 to process imageinformation captured via one or more of the integrated sensor-opticalcomponent accessories 1020, the one or more optical components 1035 andthe one or more image sensors 1040 of the image capture device 1010. Inan implementation, the processor 1045 may use the integratedsensor-optical component accessory identification information, mountinginformation and/or a combination thereof to reconfigure functionalityand/or operation of the processor 1045 and the image capture device1010. In an implementation, attachment of the integrated sensor-opticalcomponent accessory 1020 to the image capture device 1010 may result inthe field of views being in the same direction.

FIG. 11 is a side view of a diagram of an image capture system 1100including an image capture device 1110 with an attached integratedsensor-optical component accessory 1120 in opposing directions. Theimage capture system 1100 may include any or all features and/orcharacteristics described with respect to FIGS. 1-9. The description ofthe image capture device 1110 and the integrated sensor-opticalcomponent accessory 1120 is therefore summarized herein. In animplementation, a center axis of the field of view of the image capturesystem 1100 and a center axis of the field of view of the integratedsensor-optical component accessory 1120 are in different directions. Inan implementation, the different directions may include having thecenter axis of the field of view of the image capture system 1100 be 90°or 180° apart from the center axis of the field of view of theintegrated sensor-optical component accessory 1120. In animplementation, other separation angles may be used. In animplementation, a center axis of the field of view (dashed arrow) of theimage capture system 1100 and a center axis of the field of view(dashed-dotted arrow) of the integrated sensor-optical componentaccessory 1120 are in opposing directions.

The integrated sensor-optical component accessory 1120 includes a body,one or more optical components 1165 structured on the body, one or moreimage sensors internal to the body, and an interface mounting structure.The one or more image sensors and the one or more optical components1165 may form an integrated sensor-optical component assembly of theintegrated sensor-optical component accessory 1120.

The image capture device 1110 includes a body 1130, one or more opticalcomponents 1135 structured on the body 1130, one or more image sensors1140 internal to the body 1130, a processor 1145 internal to the body1130 and an interface mounting structure. In an implementation, the oneor more optical components 1135 structured on the body 1130 and the oneor more image sensors 1140 are fixed with respect to the image capturedevice 1110.

As described herein, the processor 1145 may reconfigure operation of theimage capture device 1110 including the processor 1145 to process imageinformation captured via one or more of the integrated sensor-opticalcomponent accessories 1120, the one or more optical components 1135 andthe one or more image sensors 1140 of the image capture device 1110. Inan implementation, the processor 1145 may use the integratedsensor-optical component accessory identification information, mountinginformation and/or a combination thereof to reconfigure functionalityand/or operation of the processor 1145 and the image capture device1110. In an implementation, attachment of the integrated sensor-opticalcomponent accessory 1120 to the image capture device 1110 may result inthe field of views being in different directions. In an implementation,attachment of the integrated sensor-optical component accessory 1120 tothe image capture device 1110 may result in the field of views being inopposing directions. In an implementation, attachment of the integratedsensor-optical component accessory 1120 to the image capture device 1110may result in the field of views which overlap. In an implementation,attachment of the integrated sensor-optical component accessory 1120 tothe image capture device 1110 may result in a near 360° field of view.

FIG. 12 is a flow diagram of an example method 1200 for attaching anintegrated sensor-optical component accessory to an image capture devicein accordance with embodiments of this disclosure. The method 1200includes: attaching 1210 an integrated sensor-optical componentaccessory to an image capture device; receiving 1220 integratedsensor-optical component accessory identification data by a processor orSoC on the image capture device; configuring 1230 the SoC and/or imagecapture device based on the received integrated sensor-optical componentaccessory identification data; and receiving 1240 data from at least theintegrated sensor-optical component accessory after calibration iscomplete. The method may be implemented in any of the image capturesystems described in FIGS. 5-11.

The method 1200 includes attaching 1210 an integrated sensor-opticalcomponent accessory to an image capture device. In an implementation,attachment may include mechanical coupling and electrical connectivitybetween the integrated sensor-optical component accessory and the imagecapture device. In an implementation, attachment may include mechanicalcoupling and electrical connectivity between the integratedsensor-optical component accessory, the image capture device, and aninterface module. In an implementation, attachment may include theintegrated sensor-optical component accessory receiving power from theimage capture device, the interface module, alternative power source ora combination thereof. In an implementation, attachment may includeengaging mounting structure on the image capture device with theengagement structure included on the integrated sensor-optical componentaccessory. In an implementation, attachment may include coupling theintegrated sensor-optical component accessory and the image capturedevice via a cable. In an implementation, attachment may includecoupling the integrated sensor-optical component accessory and the imagecapture device using a combination of wired and wireless technologies.In an implementation, attachment may include the integratedsensor-optical component accessory receiving power from the imagecapture device.

The method 1200 includes receiving 1220 integrated sensor-opticalcomponent accessory identification data by a processor or SoC on theimage capture device. In an implementation, the processor may receiveidentification data from an integrated sensor-optical componentaccessory or from other components of the image capture device. In animplementation, the processor may receive attachment informationindicating where and how the integrated sensor-optical componentaccessory is attached to the image capture device. For example, theattachment information may indicate which surface the integratedsensor-optical component accessory may be attached to. For example, theattachment information may indicate how the integrated sensor-opticalcomponent accessory is attached to the image capture device with respectto having same, different, non-overlapping, and overlapping fields ofview with respect to the image capture device.

The method 1200 includes configuring 1230 the processor and/or imagecapture device based on the received integrated sensor-optical componentaccessory identification data. In an implementation, the processor mayaccount for the attachment information in determining the configuration.In an implementation, the processor may process the identification dataand configure the SoC and the image capture device for operation oroptimal operation with the attached integrated sensor-optical componentaccessory. In an implementation, an image signal processor or controllermay be configured for operation or optimal operation between the imagecapture device and the integrated sensor-optical component accessory. Inan implementation, a user interface on the image capture device may beconfigured for operation between the image capture device and theintegrated sensor-optical component accessory.

The method 1200 includes receiving 1240 image data from the integratedsensor-optical component accessory after configuration is complete. Inan implementation, the processor may signal, for example via an audio orvisual signal, that configuration is complete, and the image capturedevice is now ready to use. In an implementation, the processor mayprocess image data from the integrated sensor-optical componentaccessory and ignore image data from the image capture device (byturning off or powering down the sensor and optical component of theimage capture device, for example). In an implementation, the processormay process image data from the integrated sensor-optical componentaccessory and image data from the image capture device.

In general, an image capturing system includes an integratedsensor-optical component accessory configured to capture imageinformation and an image capturing device. The image capturing deviceincludes a body, an image sensor internal to the body, the image sensorconfigured to capture image information, an optical component structuredon the body, the optical component configured to direct light to theimage sensor, and a processor configured to process selected imageinformation. The image capturing device and the processor areconfigurable based on identification data received from the integratedsensor-optical component accessory when the integrated sensor-opticalcomponent accessory is releasably attached to the image capturingdevice. In an implementation, the image capturing system furtherincludes another integrated sensor-optical component accessoryconfigured to capture image information, where the image capturingdevice and the processor are configurable based on identification datareceived from the integrated sensor-optical component accessory and theanother integrated sensor-optical component accessory when theintegrated sensor-optical component accessory and the integratedsensor-optical component accessory are releasably attached to the imagecapturing device. In an implementation, the processor is furtherconfigurable based on attachment information, wherein the attachmentinformation indicates where and how the integrated sensor-opticalcomponent accessory is attached to the image capturing device. In animplementation, the image capturing device further includes a userinterface, the user interface configurable based on the identificationdata and the attachment data. In an implementation, the integratedsensor-optical component accessory is further configured to wirelesslytransmit the image information and the identification data to the imagecapturing device. In an implementation, the image capturing deviceincluding a first mounting structure and the integrated sensor-opticalcomponent accessory including a second mounting structure, wherein thefirst mounting structure and the second mounting structure areconfigured and dimensioned for releasable attachment of the integratedsensor-optical component accessory with the image capturing device andprovide mechanical coupling and electrical connectivity between theintegrated sensor-optical component accessory and the image capturingdevice. In an implementation, the integrated sensor-optical componentaccessory is configured to draw power from the image capturing device.In an implementation, the integrated sensor-optical component accessoryincludes a first integrated sensor-optical component accessory and asecond integrated sensor-optical component accessory and the processoris further configurable to select and process image data from the firstintegrated sensor-optical component accessory and the second integratedsensor-optical component accessory and power down the image sensor andthe optical component of the image capturing device. In animplementation, the selected image information is from the integratedsensor-optical component accessory and the processor is configurable toignore the image information from the image capturing device. In animplementation, the selected image information is from the integratedsensor-optical component accessory and the processor is configurable toturn off the image sensor and the optical component of the imagecapturing device. In an implementation, the selected image informationis from the integrated sensor-optical component accessory and the imagecapturing device. In an implementation, a center axis of a field of viewof the integrated sensor-optical component accessory and a center axisof a field of view of the image capturing device are in differentdirections. In an implementation, a center axis of a field of view ofthe integrated sensor-optical component accessory and a center axis of afield of view of the image capturing device are in opposing directions.In an implementation, a field of view of the integrated sensor-opticalcomponent accessory and a field of view of the image capturing deviceare one of non-overlapping or overlapping. In an implementation, theimage capturing system further includes an interface, the interfaceconfigured to be in mechanical cooperation with the image capturingdevice and in electrical communication with the integratedsensor-optical component accessory, where the interface is configured toassist in data transfer between the integrated sensor-optical componentaccessory and the image capturing device, and where the integratedsensor-optical component accessory is configured to draw power from atleast one of the interface or the image capturing device. In animplementation, the integrated sensor-optical component accessory isconfigured to store the identification data that is transferred to theimage capturing device and the image capturing device operates theintegrated sensor-optical component accessory according to theidentification data.

In general, an image capturing apparatus includes an image capturingdevice. The image capturing device including an image sensor, an opticalcomponent configured to direct light to the image sensor, a processorfor processing selectable image information, and a first mountingstructure. The image capturing apparatus further includes an integratedsensor-optical component accessory including an image sensor configuredto capture image information, and an optical component configured todirect light to the image sensor, where the image sensor is fixed inrelation to the optical component, and a second mounting structure,where the processor is configurable based on identification datareceived from the integrated sensor-optical component accessory andattachment information when the integrated sensor-optical componentaccessory is releasably attached to the image capturing device using atleast the first mounting structure and the second mounting structure. Inan implementation, the selectable image information includes the imageinformation from the integrated sensor-optical component accessory andoperationally ignores the image capture device.

In general, a method of using an image capturing system includesreleasably attaching an integrated sensor-optical component accessory toan image capturing device, receiving integrated sensor-optical componentaccessory control information at the image capture device from theintegrated sensor-optical component accessory, where the integratedsensor-optical component accessory control information is different fordifferent integrated sensor-optical component accessories, configuring aprocessor in the image capture device and the image capture device basedon the integrated sensor-optical component accessory controlinformation, and processing selected image data based on the integratedsensor-optical component accessory control information. In animplementation, the method further includes operationally ignoring theimage capture device.

While the disclosure has been described in connection with certainembodiments, it is to be understood that the disclosure is not to belimited to the disclosed embodiments but, on the contrary, is intendedto cover various modifications and equivalent arrangements includedwithin the scope of the appended claims, which scope is to be accordedthe broadest interpretation so as to encompass all such modificationsand equivalent structures as is permitted under the law.

What is claimed is:
 1. An image capturing system, comprising: anintegrated sensor-optical component accessory configured to captureimage information, and an image capturing device including: a body; animage sensor internal to the body, the image sensor configured tocapture image information; an optical component structured on the body,the optical component configured to direct light to the image sensor;and a processor configured to process selected image information,wherein the image capturing device and the processor are configurablebased on identification data received from the integrated sensor-opticalcomponent accessory when the integrated sensor-optical componentaccessory is releasably attached to the image capturing device.
 2. Theimage capturing system of claim 1, further comprising: anotherintegrated sensor-optical component accessory configured to captureimage information, wherein the image capturing device and the processorare configurable based on identification data received from theintegrated sensor-optical component accessory and the another integratedsensor-optical component accessory when the integrated sensor-opticalcomponent accessory and the integrated sensor-optical componentaccessory are releasably attached to the image capturing device.
 3. Theimage capturing system of claim 1, wherein the processor is furtherconfigurable based on attachment information, wherein the attachmentinformation indicates where and how the integrated sensor-opticalcomponent accessory is attached to the image capturing device.
 4. Theimage capturing system of claim 3, the image capturing device furthercomprising: a user interface, the user interface configurable based onthe identification data and the attachment data.
 5. The image capturingsystem of claim 1, wherein the integrated sensor-optical componentaccessory is further configured to wirelessly transmit the imageinformation and the identification data to the image capturing device.6. The image capturing system of claim 1, the image capturing deviceincluding a first mounting structure and the integrated sensor-opticalcomponent accessory including a second mounting structure, wherein thefirst mounting structure and the second mounting structure areconfigured and dimensioned for releasable attachment of the integratedsensor-optical component accessory with the image capturing device andprovide mechanical coupling and electrical connectivity between theintegrated sensor-optical component accessory and the image capturingdevice.
 7. The image capturing system of claim 6, wherein the integratedsensor-optical component accessory is configured to draw power from theimage capturing device.
 8. The image capturing system of claim 1,wherein the integrated sensor-optical component accessory includes afirst integrated sensor-optical component accessory and a secondintegrated sensor-optical component accessory and the processor isfurther configurable to select and process image data from the firstintegrated sensor-optical component accessory and the second integratedsensor-optical component accessory and power down the image sensor andthe optical component of the image capturing device.
 9. The imagecapturing system of claim 1, wherein the selected image information isfrom the integrated sensor-optical component accessory and the processoris configurable to ignore the image information from the image capturingdevice.
 10. The image capturing system of claim 1, wherein the selectedimage information is from the integrated sensor-optical componentaccessory and the processor is configurable to turn off the image sensorand the optical component of the image capturing device.
 11. The imagecapturing system of claim 1, the selected image information is from theintegrated sensor-optical component accessory and the image capturingdevice.
 12. The image capturing system of claim 1, wherein a center axisof a field of view of the integrated sensor-optical component accessoryand a center axis of a field of view of the image capturing device arein different directions.
 13. The image capturing system of claim 1,wherein a center axis of a field of view of the integratedsensor-optical component accessory and a center axis of a field of viewof the image capturing device are in opposing directions.
 14. The imagecapturing system of claim 1, wherein a field of view of the integratedsensor-optical component accessory and a field of view of the imagecapturing device are one of non-overlapping or overlapping.
 15. Theimage capturing system of claim 1, further comprising: an interface, theinterface configured to be in mechanical cooperation with the imagecapturing device and in electrical communication with the integratedsensor-optical component accessory, wherein the interface is configuredto assist in data transfer between the integrated sensor-opticalcomponent accessory and the image capturing device, and wherein theintegrated sensor-optical component accessory is configured to drawpower from at least one of the interface or the image capturing device.16. The image capturing system of claim 1, wherein the integratedsensor-optical component accessory is configured to store theidentification data that is transferred to the image capturing deviceand the image capturing device operates the integrated sensor-opticalcomponent accessory according to the identification data.
 17. An imagecapturing apparatus, comprising: an image capturing device including: animage sensor; an optical component configured to direct light to theimage sensor; a processor for processing selectable image information;and a first mounting structure; and an integrated sensor-opticalcomponent accessory including: an image sensor configured to captureimage information; and an optical component configured to direct lightto the image sensor, wherein the image sensor is fixed in relation tothe optical component; and a second mounting structure, wherein theprocessor is configurable based on identification data received from theintegrated sensor-optical component accessory and attachment informationwhen the integrated sensor-optical component accessory is releasablyattached to the image capturing device using at least the first mountingstructure and the second mounting structure.
 18. The image capturingapparatus of claim 17, wherein the selectable image information includesthe image information from the integrated sensor-optical componentaccessory and operationally ignores the image capture device.
 19. Amethod of using an image capturing system, comprising: releasablyattaching an integrated sensor-optical component accessory to an imagecapturing device; receiving integrated sensor-optical componentaccessory control information at the image capture device from theintegrated sensor-optical component accessory, wherein the integratedsensor-optical component accessory control information is different fordifferent integrated sensor-optical component accessories; configuring aprocessor in the image capture device and the image capture device basedon the integrated sensor-optical component accessory controlinformation; and processing selected image data based on the integratedsensor-optical component accessory control information.
 20. The methodof claim 19, the method further comprising: operationally ignoring theimage capture device.